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What is claimed is: 

1. A stereo image processing apparatus subjecting image data 
obtained from a flying object (airframe) to stereo matching 
processing to generate three-dimensional data, comprising: 

data correcting means for correcting erroneous data to be 
corrected including at least noises and losses in said 
three-dimensional data by using information of external shape 
of buildings obtained from map data including said information 
of external shape. 

2. The stereo image processing apparatus according to claim 
1, wherein said data correcting means comprises: 

registration means for superimposing said 
three-dimensional data on said map data; 

area setting means for setting, for each building in the 
map data superimposed by said registration means, 
three-dimensional data included in the area within the external 
shape thereof as the candidate area of each building ; 

in-area histogram analysis means for obtaining, in each 
area set by said area setting means, statistic information from 
the three-dimensional data included in the area; 

and data modifying means for modifying, based on the 
statistic information in each area obtained by said in-area 
histogram analysis means, three-dimensional data included in 
the area. 
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3. The stereo image processing apparatus according to claim 
1 or 2, further comprising: 

image storing means for storing said image data. 

4. The stereo image processing apparatus according to claim 
1, further comprising: 

map data storing means for storing said map data. 

5. The stereo image processing apparatus according to claim 
4, further comprising: 

data storing means for storing modified three-dimensional 
data outputted from said data correcting means; 

data comparing means for comparing the three-dimensional 
data stored in said data storing means with the modified 
three-dimensional data outputted from said data correcting 
means ; and 

map data modifying means for modifying the map data stored 
in said map data storing means based on differential information 
obtained from said data comparing means. 

6. The stereo image processing apparatus according to claim 
1, wherein said flying object is an artificial satellite, and 
said image data is satellite image data obtained from said 
artificial satellite. 

7 . The stereo image processing apparatus according to claim 
1, wherein said flying object is an aircraft, and said image 
data is aircraft image data obtained from said aircraft. 
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8 . An stereo image processing apparatus subjecting image data 
obtained from a flying object (airframe) to stereo matching 
processing to generate three- dimensional data, comprising: 

area information extracting means for extracting at least 
area information of land use on the map of 

roads /railroads /rivers/ seei from map data including at least 
information of external shape of buildings; and 

data correcting means for correcting erroneous data to be 
corrected including at least noises and losses in said 
three-dimensional data by using the area information from said 
area information extracting means. 

9. The stereo image processing apparatus according to claim 
8, wherein said data correcting means comprises: 

registration means for superimposing said 
three-dimensional data on the area information from said area 
information extracting means; 

area dividing means for setting, for each building in the 
map data superimposed by said registration means, 
three-dimensional data included in the area within the external 
shape thereof as the candidate area of each building and spatially 
dividing the three-dimensional data in accordance with the area 
information on said map data; 

in-area histogram analysis means for obtaining, in each 
area set by said area setting means, statistic information from 
the three-dimensional data included in the area; 
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modification condition setting means for setting 
modification conditions of three - dimensional data corresponding 
to each area information of land use on said map data; and 

data modifying means for modifying, based on the statistic 
information in each area obtained by said in-area histogram 
analysis means and the modification conditions set by said 
modification condition setting means , the three-dimensional data 
included in the area. 

10. The stereo image processing apparatus according to claim 
8, further comprising: 

image storing means for storing said image data. 

11. The stereo image processing apparatus according to claim 
8, further comprising: 

map data storing means for storing said map data. 

12. The stereo image processing apparatus according to claim 
11 , further comprising: 

data storing means for storing modified three-dimensional 
data outputted from said data correcting means; 

data comparing means for comparing the three-dimensional 
data stored in said data storing means with the modified 
three-dimensional data outputted from said data correcting 
means ; and 

map data modifying means for modifying the map data stored 
in said map data storing means based on differential information 
obtained from said data comparing means. 



- 89 - 



13. The stereo image processing apparatus according to claim 
8, wherein said flying object is an artificial satellite, and 
said image data is satellite image data obtained from said 
artificial satellite. 

14. The stereo image processing apparatus according to claim 
8, wherein said flying object is an aircraft, and said image 
data is aircraft image data obtained from said aircraft. 

15. A stereo image processing apparatus subjecting image data 
obtained from a flying object to stereo matching processing to 
generate three-dimensional data, comprising: 

building external shape information detecting means for 
analyzing said image data to extract information of external 
shape of buildings; and 

data correcting means for correcting erroneous data to be 
corrected including at least noises and losses in said 
three-dimensional data by using the information of external shape 
of buildings obtained from said building external shape 
information detecting means. 

16. The stereo image processing apparatus according to claim 
15, wherein said data correcting means comprises: 

registration means for superimposing said 
three-dimensional data on information of external shape of 
buildings obtained from said building external shape information 
detecting means; 
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area setting means for setting, for each building in the 
map data superimposed by said registration means, 
three-dimensional data included in the area within the external 
shape thereof as the candidate area of each building; 
5 in-area histogram analysis means for obtaining, in each 

area set by said area setting means, statistic information from 
the three-dimensional data included in the area; and 

data modifying means for modifying, based on the statistic 
information in each area obtained by said in-area histogram 
10 analysis means, three-dimensional data included in the area. 

17. The stereo image processing apparatus according to claim 
15, further comprising: 

image storing means for storing said image data. 

18 . The stereo image processing apparatus according to claim 
15 15, wherein said flying object is an artificial satellite, and 

said image data is satellite image data obtained from said 
artificial satellite. 

19. The stereo image processing apparatus according to claim 
15, wherein said flying object is an aircraft, and said image 

20 data is aircraft image data obtained from said aircraft. 

20 . An stereo image processing apparatus subjecting image data 
obtained from a flying object (airframe) to stereo matching 
processing to generate three-dimensional data, comprising: 
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building external shape information detecting means for 
analyzing said image data to extract information of external 
shape of buildings; 

building external shape information comparing /combining 
5 means for comparing and combining the external shape information 
obtained from map data including at least information of external 
shape of buildings with the external shape information extracted 
from said building external shape information detecting means; 
and 

10 data correcting means for correcting erroneous data to be 

corrected including at least noises and losses in said 
three-dimensional data by using the combined information from 
said building external shape information comparing /combining 
means . 

15 21. The stereo image processing apparatus according to claim 
20, wherein said data correcting means comprises: 

registration means for superimposing said 
three-dimensional data on combined information from said 
building external shape information comparing /combining means; 

20 area setting means for setting, for each building in the 

map data superimposed by said registration means, 
three-dimensional data included in the area within the external 
shape thereof as the candidate area of each building; 

in-area histogram analysis means for obtaining, in each 

25 area set by said area setting means, statistic information from 
the three-dimensional data included in the area; and 
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data modifying means for modifying, based on the statistic 
information in each area obtained by said in-area histogram 
analysis means, three-dimensional data included in the area. 

22. The stereo image processing apparatus according to claim 
20, further comprising: 

image storing means for storing said image data. 

23. The stereo image processing apparatus according to claim 
20, further comprising: 

map data storing means for storing said map data. 

24. The stereo image processing apparatus according to claim 
23, further comprising: 

data storing means for storing modified three-dimensional 
data outputted from said data correcting means; 

data comparing means for comparing the three-dimensional 
data stored in said data storing means with the modified 
three-dimensional data outputted from said data correcting 
means ; and 

map data modifying means for modifying the map data stored 
in said map data storing means based on differential information 
obtained from said data comparing means. 

25. The stereo image processing apparatus according to claim 
20, wherein said flying object is an artificial satellite, and 
said image data is satellite image data obtained from said 
artificial satellite. 
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26. The stereo image processing apparatus according to claim 
20, wherein said flying object is an aircraft, and said image 
data is aircraft image data obtained from said aircraft. 

27 . An stereo image processing apparatus subjecting image data 
5 obtained from a flying object to stereo matching processing to 

generate three-dimensional, data, comprising: 

area information extracting means for extracting at least 
^ area information of land use on the map of 

■jaw? 

^ roads /railroads /rivers /sea from map data including at least 

CO 10 information of external shape of buildings; 

W building external shape information detecting means for 

to analyzing said image data to extract information of external 

i& shape of buildings; 

BSIS; 

building external shape information comparing/ combining 
15 means for comparing and combining the information of external 
r shape of buildings obtained from saidmap data with the information 

of external shape of buildings extracted by said building external 
shape information detecting means; and 

data correcting means for correcting erroneous data to be 
20 corrected including at least noises and losses in said 

three-dimensional data by using the combined information from 
said building external shape information comparing/combining 
means . 



25 



28. The stereo image processing apparatus according to claim 
27, wherein said data correcting means comprises: 
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registration means for superimposing said 
three-dimensional data on combined information from said 
building external shape information comparing /combining means 
and the area information from said area information extracting 
5 means ; 

area dividing means for setting, for each building in the 
map data superimposed by said registration means, 
three-dimensional data included in the area within the external 
shape thereof as the candidate area of each building r and spatially 

10 dividing the three-dimensional data in accordance with the area 
information on said map delta; 

in-area histogram analysis means for obtaining, in each 
area set by said area dividing means , statistic information of 
the three-dimensional data included in the area; 

15 modification condition setting means for setting 

modification conditions of three-dimensional data corresponding 
to each area information of land use on said map data; and 

data modifying means for modifying , based on the statistic 
information in each area obtained by said in-area histogram 

20 analysis means and the modification conditions set by said 
modification condition settingmeans , the three-dimensional data 
included in the area, 

29 . The stereo image processing apparatus according to claim 
27, further comprising: 
25 image storing means for storing said image data. 
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30. The stereo image processing apparatus according to claim 
27, further comprising: 

map data storing means for storing said map data. 



31. The stereo image processing apparatus according to claim 
5 30, further comprising: 

data storing means for storing modified three-dimensional 
data outputted from said data correcting means; 

data comparing means for comparing the three-dimensional 
data stored in said data storing means with the modified 
10 three-dimensional data outputted from said data correcting 
means ; and 

map data modifying means for modifying the map data stored 
in said map data storing means based on differential information 
obtained from said data comparing means. 



15 32. The stereo image processing apparatus according to claim 
27, wherein said flying object is an artificial satellite, and 
said image data is satellite image data obtained from said 
artificial satellite. 

33. The stereo image processing apparatus according to claim 
20 27, wherein said flying object is an aircraft, and said image 
data is aircraft image data obtained from said aircraft. 



34. A method of processing stereo images in which image data 
obtained from a flying object is subjected to stereo matching 
processing to generate three-dimensional data, comprising: 
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a step of correcting erroneous data to be corrected including 
at least noises and losses in said three-dimensional data by 
using information of external shape obtained from map data 
including at least inf ormation of external shape of buildings . 

5 35. The method according to claim 34 , wherein said step of 
correcting data to be corrected comprises the steps of : 

superimposing said three-dimensional data on said map data; 

setting, for each building in the superimposed map data, 
three-dimensional data included in the area within the external 
10 shape thereof as the candidate area of each building; 

obtaining, in this each set area, statistic information 
from the three -dimensional data included in the area; and 

modifying, based on the statistic information in said each 
area, the three-dimensional data included in the area. 

15 36. The method according to claim 34, wherein said image data 
is obtained from image storing means for storing the image data. 

37. The method according to claim 34, wherein said map data 
is obtained from map storing means for storing the map data. 

38. The method according to claim 37, further comprising the 
20 steps of: 

comparing the three-dimensional data stored in data storing 
means for storing modified three-dimensional data outputted from 
the step of correcting said data to be corrected with the modified 
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three-dimensional data corrected in the step of correcting said 
data to be corrected; and 

modifying the map datci stored in said map data storing means 
based on differential information obtained from this comparison . 

5 39 . The method according to claim 34 , wherein said flying object 
is an artificial satellite, and said image data is satellite 
image data obtained from said artificial satellite, 

40 ♦ The method according to claim 34 , wherein said flying object 
is an aircraft , and said image data is aircraft image data obtained 
10 from said aircraft. 

41. A method of processing stereo images in which image data 
obtained from a flying object is subjected to stereo matching 
processing to generate three-dimensional data, comprising the 
steps of: 

15 extracting at least area information of land use on the 

map of roads /railroads /rivers /sea from map data including at 
least information of external shape of buildings; and 

correcting erroneous data to be corrected including at least 
noises and losses in said three-dimensional data by using the 

20 extracted area information. 

42. The method according to claim 41, wherein said step of 
correcting data to be corrected comprises the steps of: 

superimposing said three-dimensional data with said area 
information; 
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setting, for each building in the superimposed map data, 
three-dimensional data included in the area within the external 
shape thereof as the candidate area of each building , and spatially 
dividing the three-dimensional data in accordance with the area 
5 information on said map data; 

obtaining, in this each set area, statistic information 
from the three -dimensional data included in the area; 

setting modification conditions of three-dimensional data 
corresponding to each area information of land use on said map 
10 data; and 

modifying, based on the statistic information in said each 
area and said modification conditions, the three -dljnensional 
data included in the area. 

43. The method according to claim 41, wherein said image data 
15 is obtained from image storing means for storing the image data. 

44. The method according to claim 41, wherein said map data 
is obtained from map storing means for storing the map data. 

45. The method according to claim 44, further comprising the 
steps of: 

20 comparing three-dimensional data stored in data storing 

means for storing modified three-dimensional data corrected in 
the step of correcting said data to be corrected with the modified 
three-dimensional data corrected in said step of correcting data 
to be corrected; and 
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modifying the map data stored in said map data storing means 
based on differential information obtained from this comparison . 

46 . The method according to claim 41 , wherein said flying object 
is an artificial satellite, and said image data is satellite 
image data obtained from said artificial satellite. 

47 . The method according to claim 41 , wherein said flying object 
is an aircraft , and said image data is aircraft image data obtained 
from said aircraft. 

48. A method of processing stereo images in which image data 
obtained from a flying object is subjected to stereo matching 
processing to generate three-dimensional data, comprising the 
steps of: 

analyzing said image data to extract information of external 
shape of buildings; and 

correcting erroneous data to be corrected including at least 
noises and losses in said three-dimensional data by using the 
extracted information of external shape of buildings, 

49. The method according to claim 48, wherein said step of 
correcting data to be corrected comprises the steps of: 

superimposing said three-dimensional data on said 
information of external shape of buildings; 

setting, for each building in the superimposed map data, 
three-dimensional data included in the area within the external 
shape thereof as the candidate area of each building; 
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obtaining, in this each set area, statistic information 
from the three-dimensional data included in the area; and 

modifying, based on the statistic information in said each 
area, the three-dimensional data included in the area. 

50. The method according to claim 48, wherein said image data 
is obtained from image storing means for storing the image data. 

5 1 . The method according to claim 48 , wherein said flying ob j ect 
is an artificial satellite, and said image data is satellite 
image data obtained from said artificial satellite. 

52 . The method according to claim 48 , wherein said flying object 
is an aircraft , and said image data is aircraft image data obtained 
from said aircraft. 

53. A method of processing stereo images in which image data 
obtained from a flying object is subjected to stereo matching 
processing to generate three-dimensional data, comprising the 
steps of: 

analyzing said image data to extract information of external 
shape of buildings; 

comparing and combining the extracted information of 
external shape of buildings with the information of external 
shape of buildings obtained from map data including at least 
information of external shape of buildings; and 
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correcting erroneous data to be corrected including at least 
noises and losses in said three-dimensional data by using this 
combined information. 

54. The method according to claim 53, wherein said step of 
correcting data to be corrected comprises the steps of: 

superimposing said three-dimensional data on said combined 
information, 

setting, for each building in the superimposed map data, 
three-dimensional data included in the area within the external 
shape thereof as the candidate area of each building; 

obtaining, in this each set area, statistic information 
from the three-dimensional data included in the area; and 

modifying, based on the statistic information in said each 
area, the three-dimensional data included in the area. 

55. The method according to claim 53, wherein said image data 
is obtained from image storing means for storing the image data. 

56. The method according to claim 53, wherein said map data 
is obtained from map data storing means for storing the map data. 

57. The method according to claim 56, further comprising the 
steps of: 

comparing three -dimensional data stored in data storing 
means for storing modified three-dimensional data corrected in 
the step of correcting said data to be corrected with the modified 
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three-dimensional data corrected in said^step of correcting data 
to be corrected; and 

modifying the map data stored in said map data storing means 
based on differential information obtained from this comparison . 

58 . The method according to claim 53 , wherein said flying object 
is an artificial satellite, and said image data is satellite 
image data obtained from said artificial satellite. 

59 . The method according to claim 53 , wherein said flying object 
is an aircraft , and said image data is aircraft image data obtained 
from said aircraft. 

60 . A method of processing images in which image data obtained 
from a flying object is subjected to stereo matching processing 
to generate three-dimensional data, comprising the steps of: 

extracting at least area information of land use on the 
map of roads/railroads/rivers/sea from map data including at 
least information of external shape of buildings; 

analyzing said image data to extract information of external 
shape of buildings; 

comparing and combining the information of external shape 
of buildings obtained from said map information with the 
information of external shape of buildings extracted in said 
step of extracting said information of external shape of 
buildings ; and 
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correcting erroneous data to be corrected including at least 
noises and losses in said three-dimensional data by using this 
combined information. 

61. The method according to claim 60, wherein said step of 
5 correcting data to be corrected comprises the steps of: 

superimposing said three-dimensional data on said combined 
information and said areci information; 

setting, for each building in the superimposed map data, 
three-dimensional data included in the area within the external 
1 0 shape thereof as the candidcite area of each building , and spatially 
dividing the three-dimensional data in accordance with the area 
information on said map data; 

obtaining, in this each set area, statistic information 
from the three-dimensional data included in the area; 
15 setting modification conditions of three-dimensional data 

corresponding to each area information of land use on said map 
data; and 

modifying, based on the statistic information in said each 
area and said modification conditions, the three-dimensional 
20 data included in the area. 

62. The method according to claim 60, wherein said image data 
is obtained from image storing means for storing the image data. 

63. The method according to claim 60, wherein said map data 
is obtained from map data storing means for storing the map data. 
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64. The method according to claim 63, further comprising the 
steps of : 

comparing the three-dimensional data stored in data storing 
means for storing modified three-dimensional data corrected in 
5 the step of correcting said data to be corrected with the modified 
three-dimensional data corrected in the step of correcting said 
data to be corrected; and 

modifying map data stored in said map data storing means 
based on differential information obtained from this comparison . 

10 65 . The method according to claim 60 , wherein said flying object 
is an artificial satellite, and said image data is satellite 
image data obtained from said artificial satellite. 

66 . The method according to claim 60 , wherein said flying object 
is an aircraft , and said image data is aircraft image data obtained 

15 from said aircraft. 

67 . A recording medium in which a program for processing stereo 
images is recorded for making a computer carry out stereo image 
processing for subjecting image data obtained from a flying object 
to stereo matching processing to generate three-dimensional data, 

20 wherein said program for processing stereo images makes said 
computer correct erroneous data to be corrected including at 
least noises and losses in the three-dimensional data by using 
at least information of eixternal shape of buildings obtained 
from map data including at least the information of external 

25 shape of buildings. 
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68 , A recording medium in which a program for processing stereo 
images is recorded for making a computer carry out stereo image 
processing for subjecting image data obtained from a flying object 
to stereo matching processing to generate three-dimensional data, 
5 wherein said program for processing stereo images makes said 
computer extract at least area information of land use on the 
map of roads/railroads/rivers/sea from map data including at 
least information of external shape of buildings, and correct 
erroneous data to be corrected including at least noises and 
10 losses in said three-dimensional data by using the extracted 
area information. 

69 . A recording medium in which a program for processing stereo 
images is recorded for making a computer carry out stereo image 
processing for subjecting image data obtained from a flying object 

15 to stereo matching processing to generate three-dimensional data, 
wherein said program for processing stereo images makes said 
computer analyze said image data to extract information of 
external shape of buildings, and correct erroneous data to be 
corrected including at least noises and losses in said 

20 three-dimensional data by using the extracted information of 
external shape of buildings. 

70 . A recording medium in which a program for processing stereo 
images is recorded for making a computer carry out stereo image 
processing for subjecting image data obtained froma flying object 
25 to stereo matching processing to generate three-dimensional data , 
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wherein said program i:or processing stereo images makes said 
computer analyze said image data to extract information of 
external shape of buildings , compare and combine the extracted 
information of external shape of buildings with the information 
5 of external shape of buildings obtained from map data including 
at least information of external shape of buildings , and correct 
erroneous data to be corrected including at least noises and 
losses in said three-dimensional data by using this combined 
information, 

10 71 . A recording medium in which a program for processing stereo 
images is recorded for making a computer carry out stereo image 
processing for subjecting Image data obtained from a flying object 
to stereo matching processing to generate three-dimensional data, 
wherein said program for processing stereo images makes said 

15 computer extract at least area information of land use on the 
map of roads/railroads/rivers/sea from map data including at 
least information of external shape of buildings, analyze said 
image data to extract information of external shape of buildings , 
compare and combine the information of external shape of buildings 

20 obtained from said map data with the information of external 
shape of buildings obtained from the analysis of said image data, 
and correct erroneous data to be corrected including at least 
noises and losses in said three-dimensional data by using the 
combined information. 



